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employment. 

Job  Opportunities  and  Basic  Skills 
(JOBS)  Program 

»■      Noncompliance  with  statutory  performance  standards. 
*■      Management  controls  could  be  improved. 
»■      Management  information  is  limited. 


Direct  comments/inquiries  to: 
Office  of  the  Legislative  Auditor 
Room  135,  State  Capitol 
Helena,  Montana  59620 


92P.43 


MONTANA  STATE  LIBRARY 

S  351.7232  L72pwp  1993  C.1 
Perlormancs  audn  report.  Department  ot 


3  0864  00084975  5 


PERFORMANCE  AUDITS 


Performance  audits  conducted  by  the  Office  of  the  Legislative  Auditor  are  designed  to  assess 
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greater  efficiency  and  economy.  In  performing  the  audit  work,  the  audit  staff  uses  audit 
standards  set  forth  by  the  United  States  General  Accounting  Office. 

Members  of  the  performance  audit  staff  hold  degrees  in  disciplines  appropriate  to  the  audit 
process.  Areas  of  expertise  include  business  and  public  administration,  statistics,  economics, 
computer  science,  communications,  and  engineering. 
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The  Legislative  Audit  Committee 
of  the  Montana  State  Legislature: 

This  is  our  performance  audit  of  the  Project  Work  Program  (PWP)  and  Job 
Opportunities  and  Basic  Skills  (JOBS)  Program  administered  by  the  Department  of 
Social  and  Rehabilitation  Services.  This  report  contains  information  for  the  legislature 
concerning  program  outcomes  and  controls.  Department  responses  are  contained  at 
the  end  of  the  report. 

We  wish  to  express  our  appreciation  to  the  staff  of  the  department  for  their 
cooperation  and  assistance. 


Respectfully  submitted. 
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Scott  A.  Seacat 
Legislative  Auditor 


Office  of  the  Legislative  Auditor 

Performance  Audit 


Project  Work  Program  (PWP) 

Job  Opportunities  and  Basic  Skills 
(JOBS)  Program 

Department  of  Social  and  Rehabilitation  Services 


Members  of  the  audit  staff  involved  in  this  audit  were  Angie  Grove  and 
Mike  Wingard.  Additional  information  on  the  audit  can  be  obtained  by 
contacting  the  Office  of  the  Legislative  Auditor  at  (406)  444-3122. 
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Introdoction 


Performance  audits  of  the  Project  Work  Program  (PWP)  and  the 
Job  Opportunities  and  Basic  Skills  (JOBS)  programs  were 
requested  by  the  51st  Legislature  to  be  presented  to  the  53rd 
Legislature.  The  PWP  program  requires  all  able-bodied  General 
Relief  Assistance  (GA)  recipients  to  participate  in  a  structured 
job  search,  training,  and  work  program.   JOBS  is  a  federally 
mandated  program  for  selected  Aid  to  Families  with  Dependent 
Children  (AFDC)  recipients  and  is  intended  to  provide  educa- 
tion, training,  and  employment  to  avoid  long-term  dependency 
on  welfare.   Both  programs  are  administered  by  the  Department 
of  Social  and  Rehabilitation  Services  (SRS). 


PWP  Issues 


During  our  audit  of  the  PWP,  we  tested  several  areas  to  deter- 
mine program  effectiveness.  We  concentrated  our  review  in  two 
areas:  management  information  and  legislative  intent. 


Actual  Program 
Outcomes 


Since  neither  program  operators  nor  the  department  verify  pro- 
gram success,  we  compiled  independent  data  on  program  perfor- 
mance results.  We  compared  the  1 ,022  PWP  placements  reported 
by  program  operators  from  April  1991  to  June  1992  to  Depart- 
ment of  Labor  and  Industry  wage  records  for  the  same  time 
period.   We  found  there  were  480  wage  records  (47  percent)  for 
the  employments  claimed  by  program  operators  for  the  same 
time  period.  Although  Department  of  Labor  and  Industry  data 
does  not  include  self-employed  or  agricultural  employments,  the 
lack  of  any  current  wage  records  for  542  (53  percent)  of  the 
"claimed"  employments  raises  serious  questions  about  the 
accuracy  of  program  data  reported  by  the  program  operators.  To 
increase  the  credibility  of  claimed  program  outcomes  the  depart- 
ment should  independently  verify  this  data. 


Does  PWP  Participation 
Affect  GA  Recidivism? 


To  further  measure  the  success  of  PWP,  we  followed  up  on  prior 
program  participants  who  received  public  assistance  and/or 
participated  in  PWP  since  a  1988  audit  of  PWP.  We  found  253  of 
the  1,518  former  GA  recipients  received  GA  benefits  between 
January  1990  and  September  1992.  The  results  of  our  1988 
review  concluded  PWP  participants  were  not  staying  off  public 
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assistance  at  a  greater  rate  than  GA  recipients  who  were  exempt 
from  participation.  In  reviewing  the  253  participants  who 
returned  to  GA,  we  found  172  former  recipients  had  been 
enrolled  in  PWPJbetween  January  7,  1990  and  September  1992. 
Of  these  172,  there  were  117  who  had  been  in  PWP  during  our 
1988  audit.   Based  on  this  information,  we  again  concluded  the 
current  Project  Work  Program  does  not  have  a  significant  posi- 
tive impact  on  the  recidivism  rate  of  public  assistance  recipients. 


Is  PWP  Meeting 
Legislative  Intent? 


Currently,  PWP  is  not  a  job  training  program.   It  operates  as  a 
mandatory  job  search  program.  This  type  of  program  does  not 
correlate  to  statutorily  defined  intent  or  to  the  performance 
standards  currently  tracked.   We  determined  509  of  our  1988 
sample  of  GA  recipients  have  received  some  type  of  assistance 
from  either  GA,  AFDC,  or  Food  Stamps  in  the  past  two  and 
one-half  years.   In  reviewing  length  of  employment  for  PWP 
placements  documented  on  the  Department  of  Labor  and  Indus- 
try database,  we  found  only  4  percent  of  the  claimed  employ- 
ments resulted  in  employment  of  a  year  or  more.  There  has  not 
been  a  significant  increase  in  earnings  of  individuals  as  a  result 
of  their  PWP  participation.  The  average  earnings  for  recent  PWP 
participants  placed  in  employment  appears  to  be  below  the 
federal  poverty  level. 


Is  PWP  Needed? 


PWP  was  put  in  place  to  address  long-term  reliance  on  GA  and 
as  a  way  to  comply  with  federal  requirements  for  a  Food  Stamp 
job  search  program.  The  concept  of  "performance  for  pay"  has 
also  been  used  to  justify  the  program  since  its  inception.  How- 
ever, since  program  creation  there  have  been  significant  changes 
which  potentially  have  reduced  the  need  for  PWP.  For  example, 
the  four-month  time  limit  for  GA  benefits  per  year  has  reduced 
the  GA  caseload.  Other  programs  have  also  been  implemented 
or  changed  to  address  the  job  search  training  needs  of  GA  recip- 
ients.  For  example,  Job  Training  Partnership  Act  (JTPA)  pro- 
grams have  been  expanded  somewhat  to  offer  more  assistance  to 
individuals  who  are  eligible  for  GA  benefits.   Although  JTPA 
programs  are  presently  serving  only  a  limited  number  of  GA 
recipients,  there  are  no  federal  regulations  prohibiting  JTPA 
from  serving  more  recipients  in  the  future.  The  combined  effect 
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of  expanding  other  job  training  programs  and  imposition  of 
time-limited  benefits  raises  the  question  of  program  "need."  We 
believe  our  audit  findings  regarding  PWP  have  again  concluded 
the  program  is  of  minimal  benefit  relative  to  reducing  reliance 
on  GA  or  increasing  the  long-term  employment  and  earnings  of 
participants.  The  legislature  should  re-define  program  intent  as 
job  search  or  discontinue  the  program. 


JOBS  Issues 


The  JOBS  program  was  created  to  provide  AFDC  recipients 
education,  training,  and  employment  that  will  help  avoid  long- 
term  welfare  dependency.  We  tested  several  operational  areas  to 
determine  statutory  compliance  and  program  effectiveness.   We 
concentrated  our  review  in  three  areas:   management  controls, 
management  information,  and  legislative  intent. 


Management  Controls 


We  believe  the  department  should  begin  focusing  on  developing 
management  controls  for  this  program.   Management  controls 
include  policies,  procedures,  and  established  administrative 
processes.  These  controls  provide  a  system  for  measurement  of 
program  activities  and  provide  managers  with  useful  perfor- 
mance information.  By  developing  goals  and  objectives,  formal- 
izing a  policy  development  process,  and  addressing  staffing 
concerns,  program  administration  could  be  more  effective. 
Although  the  department  had  indicated  some  controls  are  in 
place,  we  believe  additional  steps  can  be  made.  The  department 
should  establish  a  formal  system  of  management  controls. 


JOBS  Management 
Information 


Due  to  the  department's  limited  JOBS  management  information, 
we  do  not  believe  its  efforts  specifically  measure  the  perfor- 
mance standards  outlined  in  current  statute.  The  management 
information  system  currently  used  is  not  designed  to  track  any  of 
the  prescribed  performance  standards.  For  example,  the  depart- 
ment has  no  method,  as  required  by  law,  to  track  the  dollar 
savings  to  AFDC  as  a  direct  result  of  JOBS.  The  credibility  of 
the  program  is  also  in  doubt  due  to  the  lack  of  independent 
department  verification  of  program  performance.   Data  from 
other  departments  is  not  used  to  verify  and  supplement  current 
program  management  information.  Based  on  our  audit  testing. 
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we  believe  the  department  should  take  steps  to  improve  the 
reliability  and  completeness  of  JOBS  management  information. 


Is  the  JOBS  Program 
Meeting  Legislatiye 
Intent? 


Legislative  intent  in  the  JOBS  statutes  is  defined  as  providing 
recipients  of  AFDC  the  education,  training,  and  employment 
that  will  help  avoid  long-term  welfare  dependency.  To  deter- 
mine how  successful  this  program  is  in  reducing  reliance  on 
public  assistance,  we  reviewed  the  AFDC  database  to  determine 
if  those  participants  placed  into  employment  by  JOBS  program 
operators  were  no  longer  receiving  AFDC  benefits.   Of  the  662 
employments  claimed  since  January  1990,  we  found  there  were 
505  clients  (76  percent)  still  receiving  AFDC  benefits  in  the  past 
six  months.  We  also  found  overall  AFDC  caseloads  have  not 
significantly  decreased  during  the  three  years  JOBS  has  been  in 
operation. 


The  department  has  indicated  the  JOBS  program  will  require  a 
long-term  commitment  to  program  recipients,  but  we  were  not 
able  to  document  any  definition  of  what  constitutes  a  "long- 
term"  commitment.  The  department  is  currently  not  measuring 
short-term  or  long-term  program  performance.  We  believe  the 
department  should  consider  establishing  a  management  plan 
which  identifies  those  areas  which  could  be  measured  on  a  short- 
term  basis  in  addition  to  monitoring  the  long-term  outcomes 
specified  in  the  statutory  performance  standards. 
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Introduction 


Performance  audits  of  the  Project  Work  Program  (PWP)  and  the 
Job  Opportunities  and  Basic  Skills  (JOBS)  program  were 
requested  by  the  51st  Legislature  to  be  presented  to  the  53rd 
Legislature.  The  PWP  program  requires  all  able-bodied  General 
Relief  Assistance  (GA)  recipients  to  participate  in  a  structured 
job  search,  training,  and  work  program.  JOBS  is  a  federally 
mandated  program  for  selected  Aid  to  Families  with  Dependent 
Children  (AFDC)  recipients  and  is  intended  to  provide  educa- 
tion, training,  and  employment  to  avoid  long-term  dependency 
on  welfare.   Both  programs  are  administered  by  the  Department 
of  Social  and  Rehabilitation  Services  (SRS).   We  conducted 
limited  scope  performance  audits  of  both  programs.  This 
chapter  outlines  the  scope  and  objectives  of  the  audits. 


Audit  Objectives 


Our  general  objectives  for  reviewing  both  programs  were  to 
determine  if: 

1.  The  department  is  in  compliance  with  the  program  perfor- 
mance requirements  outlined  in  state  law. 

2.  Appropriate  monitoring  of  these  performance  standards 
occurs  and  is  used  by  the  department  to  manage  the  pro- 
grams. 

3.  Programs  are  meeting  prescribed  legislative  intent. 

4.  These  programs  are  reducing  reliance  on  public  assistance. 

5.  Methods  used  to  compile  program  information  ensure  data  is 
complete  and  accurate. 


Audit  Scope  and 
Methodologies 


This  audit  was  conducted  in  accordance  with  governmental 
auditing  standards  for  performance  audits.  We  concentrated  our 
review  on  compliance  with  performance  standards  outlined  in 
sections  53-3-327  and  53-4-718,  MCA.   We  also  compiled  infor- 
mation on  program  outcomes.  Our  review  focused  on  the  depart- 
ment's central  office  operations  rather  than  county  level  controls, 
although  we  examined  department  procedures  for  monitoring 
program  activities  at  the  local  level. 
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We  concentrated  our  audit  work  in  two  areas:  management  infor- 
mation and  legislative  intent.   In  the  management  information 
area,  we  examined  department  efforts  to  document  statutorily 
outlined  performance  standards.   Available  information  was 
verified  through  independent  sources  such  as  the  Department  of 
Labor  and  Industry  and  program  operators.   Program  operators 
are  nonprofit  organizations  that  contract  with  SRS  to  operate 
these  programs.   We  relied  on  audit  testing  of  major  computer 
systems  conducted  during  our  previous  audits  of  SRS. 

The  second  area  relating  to  legislative  intent  involved  examina- 
tion of  whether  the  programs  are  effective  in  preventing  long- 
term  reliance  on  public  assistance  benefits.   Department  proce- 
dures for  verifying  and  analyzing  current  program  activities 
were  examined.  We  compared  program  outcomes  to  the  desig- 
nated legislative  intent  for  each  program  to  determine  if  intent 
was  being  met.   For  PWP,  we  reviewed  a  sample  of  GA  recip- 
ients selected  in  our  1988  audit  (88P-35)  of  PWP. 


Audit  Scope  Limitations 


Our  ability  to  meet  the  prescribed  audit  objectives  was  limited 
for  the  programs  due  to  the  constraints  of  the  current  manage- 
ment information  systems.   Data  on  JOBS  program  outcomes  was 
not  readily  available,  such  as  determining  the  extent  the  program 
is  reducing  the  reliance  on  public  assistance.  Data  also  was  not 
available  for  all  PWP  activities  between  January  1988  and  Janu- 
ary 1990. 


Compliance 


Compliance  with  state  statutory  performance  standards  was 
examined.  We  did  not  specifically  test  for  compliance  at  the 
county  and  operator  level  since  this  testing  is  performed  by 
department  staff  during  their  on-site  monitoring  visits.   We  did 
review  the  monitoring  procedures  used  by  department  staff  dur- 
ing those  on-site  reviews. 


Although  we  did  not  specifically  test  for  federal  compliance, 
JOBS  operations  are  tested  periodically  by  a  federal  review  team 
from  the  U.S.  Department  of  Health  and  Human  Services.  The 
last  JOBS  review  was  completed  in  June  1991. 
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Recommendations  were  made  in  relation  to  program  manage- 
ment, service  delivery,  financial  management,  and  data  collec- 
tion. We  reviewed  the  changes  proposed  by  the  department  for 
these  areas  and  what  improvements  were  made.  We  report  areas 
of  noncompliance  with  laws  and  regulations  that  came  to  our 
attention  during  the  course  of  this  audit  in  Chapters  III  and  V. 


Management  Memoran- 
dams 


During  the  course  of  the  audit,  we  asked  program  officials  for 
written  responses  to  certain  audit  issues.   In  addition,  we  sent 
management  memorandums  on  issues  which  were  less  significant. 
These  memorandums  addressed: 


1.  Providing  management  training  to  program  staff. 

2.  Documenting  decisions  relating  to  a  possible  conflict  of  inter- 
est concerning  a  previous  SRS  employee. 


Report  Organization 


This  report  is  divided  into  two  main  sections.  Chapters  II  and  III 
outline  the  PWP  program  and  our  findings  related  to  that  pro- 
gram. Chapters  IV  and  V  describe  the  JOBS  program  and  areas 
needing  improvement. 
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Introduction  GA  is  designed  to  provide  public  assistance  for  basic  necessities 

and  medical  needs  for  people  in  need  of  assistance.  This  pro- 
gram is  only  offered  in  the  12  counties  which  have  elected  to 
have  the  state  assume  welfare  administrative  responsibilities.  In 
1986  the  legislature  enacted  the  PWP  which  requires  all  able- 
bodied  GA  recipients  to  participate  in  a  structured  job  search, 
training,  and  work  program. 

In  March  1988,  our  office  issued  a  performance  audit  report  on 
the  success  of  PWP  in  getting  GA  recipients  into  employment 
and  off  public  assistance.   At  that  time,  we  concluded  the  PWP 
program  did  not  increase  the  withdrawal  rate  of  recipients  from 
public  assistance  and  was  not  resulting  in  significant  cost  sav- 
ings. The  51st  Legislature  in  1989  enacted  specific  statutory 
changes  in  PWP.  These  changes  included  the  creation  of  measur- 
able performance  standards.  These  standards,  which  are  set 
forth  in  section  53-3-327,  MCA,  require  the  quantifiable 
measurement  of: 

1 .  Placement  and  retention  of  participants  in  unsubsidized 
employment. 

2.  Increased  earnings  of  participants  due  to  unsubsidized 
employment. 

3.  Reduction  in  the  number  and  grant  amounts  of  individuals 
and  families  receiving  GA. 

SRS  is  statutorily  required  to  monitor  these  areas  to  determine 
level  of  program  performance,  identify  administrative 
efficiencies,  and  determine  the  level  of  program  coordination 
taking  place.  SRS  is  also  required  to  measure  the  extent  program 
participation  increases  the  employment  and  earnings  of  partici- 
pants and  decreases  their  dependency  on  public  assistance. 
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Does  PWP  Serve  aU  GA 
Recipients? 


Only  GA  recipients  determined  to  be  employable  are  required  to 
enroll  in  PWP.  Of  the  1 1,200  GA  cases  in  fiscal  year  1991-92, 
there  were  4,990  persons  referred  to  PWP  who  were  considered 
employable.  There  are  different  time  limits  and  requirements 
for  GA  recipients  who  are  determined  to  be  unemployable  or 
temporarily  unemployable.   A  person  who  has  a  serious  handicap 
that  prohibits  employment  is  categorized  as  unemployable. 
These  participants  are  referred  to  a  medical  provider  to  certify 
the  condition  prevents  that  person  from  working.  Those  GA 
recipients  deemed  unemployable  are  afforded  benefits  for  as 
long  as  needed. 


A  temporarily  unemployable  person  is  considered  transitionally 
needy  and  may  be  granted  up  to  six  months  of  benefits  during  a 
twelve-month  period.  For  example,  someone  who  is  unable  to 
work  due  to  an  illness  may  be  categorized  as  temporarily 
unemployable.  These  recipients  are  required  to  participate  in 
programs  designed  to  reduce  reliance  on  public  assistance.   In 
fiscal  year  1991-92,  approximately  3,500  participants  could  have 
been  designated  as  temporarily  unemployable.  The  following 
figure  illustrates  the  number  of  participants  in  each  category. 
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Figure  1 


Nfber  of  GA  Participants  in  Each  Category 
Fiscal  Years  1989-90  through  1991-92 


FY  90 
Unduplicated  Count 


FY  91 


FY  92 


I  Employable  ^Temp.  Unemployable  Din  Unemployable 


Source:     Conpfled  by  the  Office  of  the  Legislative  Auditor  froa 
SRS  records 


Any  GA  recipient  who  without  good  cause  refuses  to  participate 
in  a  required  program  or  to  perform  work  as  assigned  will  lose 
benefits  for  three  months  for  the  first  refusal  and  six  months  for 
any  subsequent  refusal.   In  fiscal  year  1992-93,  persons  new  to 
Montana  who  are  eligible  for  GA  benefits  receive  benefits  $50 
below  the  standard  amount  for  the  first  two  months  of  their 
Montana  residency.  GA  benefits  also  may  be  initially  withheld 
for  four  full  weeks  until  the  designated  structured  job  search, 
training,  workfare,  or  self-sufficiency  program  is  completed. 
The  fiscal  year  1991-92  average  GA  caseload  was  945  persons 
with  an  average  payment  of  $246.52.   The  following  table 
illustrates  GA  monthly  benefit  amounts  based  on  household  size. 
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Table 

1 

Nonthlv  GA  Benefits 

Nunber  of  Pe 

rsons 

Monthly 

in  Household 

Benefits 
$229 

1 

2 

310 

3 

390 

4 

470 

5 

550 

6 

630 

7 

711 

8 

791 

9 

829 

10 

866 

11 

899 

Source: 

Acfainistrat 

ive 

Rules 

of  Montana 

In  addition  to  job  search  and  training,  a  GA  recipient  is  required 
to  participate  in  Workfare  if  work  sites  are  available.   Workfare 
is  used  to  provide  work  experience  and  training  for  GA  recip- 
ients in  work  projects  operated  by  a  public  or  private  nonprofit 
agency. 


What  is  PWP? 


In  the  12  state-assumed  counties  where  GA  is  available,  recip- 
ients designated  as  "employable"  are  referred  to  PWP.  PWP 
consists  of  three  separate  but  sequential  components: 

1.  Intake,  Assessment  and  Work  Experience  Component. 

2.  Initial  Month's  Training  Component. 

3.  Successive  Months'  Training  Component. 

The  Intake  component  is  the  starting  point  for  participants. 
Each  participant's  employability  level  is  determined  by  program 
operators  and  formal  assessments  may  occur  to  identify  any 
serious  barriers  to  employment,  such  as  chemical  dependency  or 
illiteracy.   Participants  then  begin  work  experience  assignments 
until  an  opening  in  the  Initial  Month's  Training  Component 
becomes  available. 
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The  second  component  consists  of  up  to  20  days  of  job  search 
and  additional  work  experience.   Work  experience  assignments 
are  limited  to  a  few  available  work  sites.   Job  search  activities 
must  account  for  at  least  50  percent  of  each  participant's  time  in 
this  component. 

For  those  participants  who  do  not  become  employed  during  the 
second  component,  the  next  step  is  the  Successive  Months'  Com- 
ponent. During  this  phase  an  employability  development  plan 
for  each  individual  is  to  be  prepared  which  outlines  the 
specialized  job  search,  training  or  treatment  needed  to  direct 
program  participation.   Activities  such  as  job  search,  work 
experience,  job  readiness  training,  job  skills  training,  and 
remedial  education  may  be  available  in  this  component  if  fund- 
ing is  available.  Chemical  dependency  rehabilitation  and  peer 
counseling  are  also  available.  The  length  of  time  in  this 
component  will  vary  by  participant.   For  participants  with 
serious  employment  barriers,  this  component  will  likely  last 
longer  than  one  month.   Program  participation  ends  when  the 
GA  recipient  becomes  successfully  employed  or  when  the  time 
limit  for  receiving  benefits  is  reached.   GA  benefits  are  available 
for  employable  participants  for  only  four  months  in  a  twelve- 
month period. 

Supportive  services  are  also  available  to  PWP  participants  during 
the  various  components.   These  services  can  include  grooming, 
transportation,  clothing,  and  child  care  expenses.  These  services 
are  provided  to  assist  participants  in  achieving  sustainable 
employment. 


Program  Funding  The  following  table  illustrates  funding  levels  for  GA  benefits 

and  the  PWP  program  for  fiscal  year  1991-92  and  projected  costs 
for  the  upcoming  biennium.  SRS  receives  state  and  federal 
funding  to  administer  the  PWP  program.   Projected  PWP  General 
Fund  expenditures  for  each  year  of  the  1994-95  biennium  is 
$522,142. 
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Table   2 

Statewide  GA  t  PUP  Ftnli 

ng  Levels 

Fiscal  Years 

1991-92  through  1994-95 

FY92 

FY93 

FY94 

FY95 

Actual 

Projected 

Projected 

Projected 

GA 

$2,685,132 

$3,052,450 

$3,103,127 

$3,103,127 

PWP 

623.418 

651.776 

657.526 

657.526 

Total 

$3,308,550 

$3,704,226 

$3,760,653 

$3,760,653 

FY92 

FY93 

FY94 

FY95 

Actual 

Projected 

Projected 

Projected 

General 

Fund 

$2,945,162 

$2,945,162 

$3,445,880 

$3,445,880 

Federal 

Funds 

363.388 

363.388 

314.773 

314.773 

Source: 

LFA 

$3,308,550 

$3,704,226 

$3,760,653 

$3,760,653 

Budget  Analys 

is  and  Governor's  Executive  Budget  for 

the 

1995  Bienniui 

The  following  table  outlines  county  PWP  funding  levels,  includ- 
ing supportive  services  for  the  12  state-assumed  counties  for 
fiscal  year  1992-93. 


Table   3 

Montana  PW>  Funding  Levels  By  Comty 

Fiscal  Year  1992-93 

COUNTY 

FUNDING  LEVEL 

Cascade 

$  133,826 

Deer  Lodge/Powell 

22,963 

Flathead 

21,576 

Lake 

6,541 

Lewis  &  Clark 

100,218 

Lincoln 

22.460 

Mineral 

2,928 

Missoula 

103,272 

Park 

12,078 

Ravalli 

16,608 

silver  Bow 

119.180 

Total 

$  561,650* 

*     Does  not   include  SRS  administration  costs 

Source:         Coapiled  by  the  Office  of  the  Legislative  Auditor               | 

froa  SRS  Records 
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SRS  provides  PWP  services  in  the  state-assumed  counties  through 
contracted  program  operators.   Program  operators  at  the  county 
level  include  Department  of  Labor  and  Industry  Job  Service 
offices.  Human  Resource  Development  Councils  (HRDC),  and 
various  nonprofit  corporations. 


Program  Administratioii  PWP  was  administered  by  the  Department  of  Labor  and  Industry 

when  the  program  began  in  1986.  In  January  1990,  SRS  assumed 
administrative  responsibilities.  The  department  has  assigned  one 
staff  person  the  primary  PWP  administration  duties.  This  person 
is  responsible  for  monitoring  operator  activities  and  developing 
policies  and  procedures.  Local  administrative  duties  are  per- 
formed by  program  operators  and  county  welfare  offices  in  each 
of  the  12  state-assumed  counties. 
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Introduction 


During  our  audit  of  the  PWP,  we  tested  several  areas  to 
determine  program  effectiveness.   We  concentrated  our  review  in 
two  areas:   management  information  and  legislative  intent. 


PWP  Management 
Infonnation 


As  part  of  our  audit  testing,  we  reviewed  available  management 
information  used  to  track  PWP  activity.  To  determine  accuracy 
and  usefulness  of  SRS  data,  we  reviewed  department  reports  and 
conducted  staff  interviews.   We  compared  program  information 
to  data  from  other  departments  and  program  operators. 


The  Department  is  Gener- 
ally Measuring  Mandated 
Performance  Standards 


We  found  the  department  is  generally  in  compliance  with  the 
requirement  to  quantitatively  measure  the  performance  standards 
outlined  in  the  statutes.   Department  reports  are  available  for 
most  of  the  designated  standards.  Reports,  such  as  client  employ- 
ment, recidivism,  and  GA  population  trends  document  the  initial 
placement  and  retention  of  participants  in  employment.   While 
identifying  reductions  in  the  number  and  grant  amounts  of  indi- 
viduals and  families  is  not  done  for  specific  participants,  overall 
trends  in  GA  populations  and  benefits  paid  are  tracked  each 
month. 


Performance  Standards 
Where  the  Department 
Could  Strengthen  Efforts 


The  department  could  make  improvements  in  how  it  measures 
and  monitors  administrative  efficiency.  For  example,  while 
reports  are  compiled  on  PWP  activities,  there  is  no  actual  verifi- 
cation of  the  reported  information.   During  on-site  monitoring 
visits,  department  staff  concentrate  on  program  operator  files, 
not  on  the  local  program's  results.  The  department's  methods  for 
monitoring  program  performance  could  be  improved  to  provide 
a  more  comprehensive  measure  of  performance  and  to  fully 
assess  administrative  efficiency.   In  response  to  our  recommenda- 
tions, the  department  has  indicated  quarterly  verifications  of 
employment  information  will  be  performed  in  the  future. 

We  also  found  limited  on-going  program  coordination  efforts 
with  other  job  training  programs.  Program  coordination  was 
included  in  the  program  performance  standards  to  encourage 
sharing  resources  and  preventing  duplication  of  services  between 
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the  various  programs.   Recent  steps  have  been  taken  to  improve 
program  coordination  via  the  formation  of  several  multi-agency 
work  groups.   Prior  to  these  efforts,  extensive  program 
coordination  either  internally  or  with  other  job  training 
programs  was  not  occurring. 


Management  Information 
is  Accurate  but  Limited  in 
Some  Areas 


During  our  review  of  PWP,  we  examined  department  reports  on 
program  activities  and  found  them  to  be  accurate  although 
limited  in  some  areas.  One  needed  improvement  is  to  use  addi- 
tional types  of  management  information  to  measure  the  overall 
success  and  impact  of  program  operations.   For  example,  the 
department  has  limited  data  on  the  actual  length  of  employment 
of  PWP  placements.   While  the  department  is  planning  to  run 
quarterly  comparisons  of  claimed  PWP  employment  data  to 
Department  of  Labor  and  Industry  wage  history  records,  this  has 
not  been  an  area  routinely  examined  by  department  staff. 
Department  monitoring  concentrates  on  compliance  and  program 
operators'  files. 


Actual  Program  Outcomes 


We  found  program  operators  generally  do  not  verify  participants' 
claimed  employment  or  reported  wage  levels  with  employers. 
Since  neither  program  operators  nor  the  department  verify  pro- 
gram success,  we  compiled  independent  data  on  program  perfor- 
mance results.   We  compared  the  1,022  PWP  placements  reported 
by  program  operators  from  April  1991  to  June  1992  to  Depart- 
ment of  Labor  and  Industry  wage  records  for  the  same  time 
period.  We  found  there  were  480  wage  records  (47  percent)  for 
the  employments  claimed  by  program  operators  for  the  same 
time  period.   Although  Department  of  Labor  and  Industry  data 
does  not  include  self-employed  or  agricultural  employments,  the 
lack  of  any  current  wage  records  for  542  (53  percent)  of  the 
"claimed"  employments  raises  serious  questions  about  the 
accuracy  of  program  data  reported  by  the  program  operators. 
Based  on  our  findings,  department  program  data  supplied  by 
program  operators  does  may  not  always  reflect  the  actual 
employment  history  of  PWP  participants  placed  into  employ- 
ment. To  increase  the  credibility  of  claimed  program  outcomes 
the  department  should  independently  verify  this  data. 
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Recidivism  to  Public 
Assistance 


To  further  measure  the  success  of  PWP,  we  followed  up  on  prior 
program  participants  who  received  public  assistance  and/or 
participated  in  PWP  since  our  1988  audit.   We  assumed  that  as  a 
tool  for  reducing  reliance  on  public  assistance,  PWP  participation 
should  result  in  a  smaller  percentage  of  those  individuals  return- 
ing to  public  assistance  than  those  not  participating  in  PWP.  To 
make  this  comparison  we  performed  the  following  testing: 

1.  Examined  department  recidivism  reports. 

2.  Documented  the  number  of  people  from  our  1988  PWP  audit 
sample  of  1,518  GA  recipients,  which  included  PWP  partici- 
pants, who  re-entered  the  GA  program. 

3.  Documented  the  number  of  people  from  our  1988  sample 
who  are  or  have  received  other  forms  of  public  assistance, 
such  as  AFDC  and  Food  Stamps,  between  January  1990  and 
September  1992. 


Does  PWP  Participation 
Affect  GA  Recidivism? 


We  compared  members  of  our  1988  sample  to  current  GA  and 
PWP  databases  to  determine  if  any  former  recipients  received 
benefits  between  January  1990  and  September  1992.  We  were 
not  able  to  find  any  wage  or  public  assistance  records  for  1,008 
of  the  former  recipients.   We  did  compile  additional  information 
for  the  remaining  recipients  by  reviewing  various  state  data- 
bases.  We  found  253  of  the  1,518  former  GA  recipients  received 
GA  benefits  during  the  designated  time  period. 


The  results  of  our  1988  review  concluded  PWP  participants  were 
not  staying  off  public  assistance  at  a  greater  rate  than  GA 
recipients  who  were  exempt  from  participation.   In  reviewing 
the  253  participants  who  returned  to  GA,  we  found  172  former 
recipients  had  been  enrolled  in  PWP  between  January  7,  1990 
and  September  1992.  Of  these  172,  there  were  117  who  had  been 
in  PWP  during  our  1988  audit.   Based  on  this  information,  we 
again  concluded  the  current  Project  Work  Program  does  not  have 
a  significant  positive  impact  on  the  recidivism  rate  of  public 
assistance  recipients. 
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Is  PWP  Meeting  Legisla- 
tive Intent? 


The  1986  special  session  of  the  legislature  created  PWP  with  the 
intent  of  reducing  dependency  on  GA  by  requiring  job  training 
for  GA  recipients.  The  1989  legislative  intent  for  PWP,  outlined 
in  the  specified  performance  standards,  emphasizes  employment 
for  program  participants. 


Currently,  PWP  is  not  a  job  training  program.  It  operates  as  a 
mandatory  job  search  program.   Although  job  readiness  skills 
may  be  learned  at  work  sites,  there  is  no  actual  job  or  occupa- 
tional training  offered  by  program  operators.  This  type  of  pro- 
gram does  not  correlate  to  statutorily  defined  intent  or  to  the 
performance  standards  currently  tracked.   This  inconsistency  was 
illustrated  when  we  compiled  independent  data  on  the  current 
level  of  reliance  on  public  assistance  and  length  of  employment 
of  former  program  recipients. 

We  determined  509  of  our  1988  sample  of  GA  recipients  have 
received  some  type  of  assistance  from  either  GA,  AFDC,  or 
Food  Stamps  in  the  past  two  and  one-half  years.  The  following 
figure  illustrates  the  number  of  PWP  participants  who  have 
received  assistance  and  those  who  had  no  record  of  assistance. 
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Figure  2 

Percent  of  Participants  Betuming  to 

Pti)lic  Assistance  who  were  Enrolled  in  PUP 

January  1990  -  Septeiter  1992 


Record  of  PWP 
Activity 


PWP  -  No  Record  o( 
Assistance 


31% 


Non-PWP  No 
Record  of 
Assistar)ce  35% 


Non-PWP  Received 
Assistance 


No  Record  of  PWP 


Activity 

PWP  and  Non-PWP  Breakout 


Source:  Coapiled  by  the  Office  of  the  Legislative  Auditor 


In  reviewing  length  of  employment  for  PWP  placements  docu- 
mented on  the  Department  of  Labor  and  Industry  database,  we 
found  only  4  percent  of  the  claimed  employments  resulted  in 
employment  of  a  year  or  more.  The  following  figure  illustrates 
the  percent  and  length  of  employments  with  reported  wage 
histories. 
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Figure  3 

Length  of  Ew>lovents  of  Recent  PMP  Ptacewents 
April  1991  through  Jme  1992 


Source:  Coapiled  by  the  Office  of  the  Legislative 
Auditor  frca  S8S  records 


To  determine  if  PWP  employment  placements  increased  partici- 
pant's employment  and  earnings,  we  compiled  data  on  the  level 
of  earnings.  We  found  there  has  not  been  a  significant  increase 
in  earnings  of  individuals  as  a  result  of  their  PWP  participation. 
There  were  4,256  PWP  participants  enrolled  from  April  1991 
through  June  1992.   We  found  there  were  reported  earnings  for 
480  PWP  placements  on  the  Department  of  Labor  and  Industry's 
wage  database  for  this  same  time  period.  Although  a  total  of 
$1,571,000  in  earnings  was  documented  for  former  PWP  partici- 
pants, this  averages  to  annual  earnings  of  about  $2,619  per 
participant.  The  federal  average  poverty  level  in  1992  was 
$6,816  for  a  family  of  one  in  the  federal  census  report.  The 
average  earnings  for  recent  PWP  participants  placed  in  employ- 
ment appears  to  be  below  the  federal  poverty  level. 
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Is  PWP  Needed? 


PWP  was  put  in  place  to  address  long-term  reliance  on  GA  and 
as  a  way  to  comply  with  federal  requirements  for  a  Food  Stamp 
job  search  program.  The  concept  of  "performance  for  pay"  has 
also  been  used  to  justify  the  program  since  its  inception.   How- 
ever, since  program  creation  there  have  been  significant  changes 
which  potentially  have  reduced  the  need  for  PWP.   For  example, 
the  four-month  time  limit  for  GA  benefits  per  year  has  reduced 
the  GA  caseload.  The  following  figure  illustrates  trends  in  GA 
caseloads,  when  time-limited  benefits  were  implemented,  and 
projected  caseloads  for  fiscal  years  1993-94  and  1994-95. 


Figure  4 

Average  GA  Caseloads 
Fiscal  Years  1983-84  throt^  1994-95 
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Coi^>iled  by  the  Office  of  the  Legislative  Auditor 
frca  SRS  records 

There  could  be  additional  changes  in  GA  caseload  with  the 
statutory  changes  enacted  during  the  July  1992  special  session  of 
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the  legislature.  For  example,  the  $50  reduction  in  benefits  for 
new  Montana  residents  could  impact  caseloads. 


Intent  Should  be  Re- 
Defined  or  PWP  Should  be 
Discontinued 


Other  programs  have  also  been  implemented  or  changed  to 
address  the  job  search  training  needs  of  GA  recipients.   For 
example,  Job  Training  Partnership  Act  (JTPA)  programs  have 
been  expanded  somewhat  to  offer  more  assistance  to  individuals 
who  are  eligible  for  GA  benefits.   Although  JTPA  programs  are 
presently  serving  only  a  limited  number  of  GA  recipients,  there 
are  no  federal  regulations  prohibiting  JTPA  from  serving  more 
recipients  in  the  future.  The  combined  effect  of  expanding 
other  job  training  programs  and  imposition  of  time-limited 
benefits  raises  the  question  of  program  "need."  We  believe  our 
audit  findings  regarding  PWP  have  again  concluded  the  program 
is  of  minimal  benefit  relative  to  reducing  reliance  on  GA  or 
increasing  the  long-term  employment  and  earnings  of  partic- 
ipants. 


Recommendation  #1 

We  recommend  the  legislature  re-define  program  intent  as 
job  search  or  discontinue  the  program. 
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Introduction 


The  Job  Opportunities  and  Basic  Skills  (JOBS)  program  is  a 
federally- mandated  program  for  selected  recipients  of  Aid  to 
Families  with  Dependent  Children  (AFDC)  benefits.   AFDC  is  a 
federal  program  designed  to  provide  cash  assistance  to  low- 
income  families  who  have  dependent  children.  The  JOBS 
requirements  are  based  on  the  work  provisions  of  the  federal 
Family  Support  Act  of  1988.  The  Family  Support  Act  is 
federally  administered  by  the  Office  of  Family  Assistance, 
Department  of  Health  and  Human  Services.  JOBS  is  intended  to 
assure  AFDC  recipients  obtain  the  education,  training,  and 
employment  needed  to  avoid  long-term  dependency  on  welfare. 
Each  state  is  required  to  administer  a  JOBS  program. 


What  is  JOBS? 


Potential  JOBS  participants  are  initially  screened  by  eligibility 
technicians  at  the  county  welfare  offices  during  their  application 
for  AFDC  benefits.  County  staff  determine  whether  AFDC 
recipients  are  mandatory  for  participation  or  exempt  from  the 
JOBS  program.  On  the  average,  about  30  percent  of  AFDC 
recipients  are  exempt  from  program  participation.   The  follow- 
ing list  outlines  some  of  the  federally-established  reasons  a 
person  could  be  exempt  from  JOBS: 

1 .  The  department  determines  it  does  not  have  the  resources  to 
provide  program  services. 

2.  The  program  is  not  available  in  the  county  the  person  resides. 

3.  The  person  is  under  the  age  of  16. 

4.  The  person  resides  at  a  location  more  than  two  hours  round 
trip  in  commuting  time. 

5.  The  person  is  age  16  to  18  and  is  enrolled  and  attending 
school  as  a  full-time  student. 

6.  A  child  in  the  household  is  under  the  age  of  three. 

All  mandatory  JOBS  participants  are  referred  to  a  JOBS  program 
operator  for  program  orientation.  Program  orientation  is  a  brief 
overview  of  the  various  program  activities  and  includes  staff 
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from  various  community  agencies  describing  the  services  they 
provide.  After  orientation,  the  JOBS  program  operator  enrolls 
those  participants  they  believe  can  most  benefit  from  program 
participation. 

JOBS  program  staff  make  an  initial  assessment  of  the  needs, 
skills,  and  employability  of  each  participant.  On  the  basis  of  the 
assessment,  program  staff  and  the  participant  develop  an 
employability  plan.  This  plan  should  specify  the  participant's 
obligations,  the  duration  of  participation,  and  services  and 
activities  needed  to  achieve  employment.  Case  management 
services  are  also  provided.  The  case  manager  will  assess  the 
educational,  child  care,  and  other  supportive  services  needs  of 
the  participant.  Case  managers  are  responsible  for  the  actual 
coordination  of  the  participants'  activities  to  ensure  the  most 
appropriate  service  delivery. 

An  individual  who  without  good  cause  fails  to  participate  in  the 
JOBS  program  as  required,  or  who  without  good  cause  refuses  to 
accept  suitable  employment,  can  be  sanctioned  and  lose  eligi- 
bility for  AFDC  benefits.  In  Montana,  the  average  AFDC 
amount  for  a  family  of  three  is  $390  per  month.  A  JOBS  partici- 
pant who  loses  AFDC  eligibility  for  any  reason  other  than  sanc- 
tion may  continue  to  receive  case  management  activities  and 
supportive  services  for  an  additional  90  days.  A  participant  who 
loses  eligibility  due  to  excess  earned  income  may  also  receive 
case  management  activities,  supportive  services,  and  child  care 
until  their  required  training  is  completed. 


Program  Organization 


In  Montana,  SRS  has  been  assigned  administrative  responsibility 
for  this  program.  To  meet  program  intent,  the  department  is 
required  to  make  available  a  broad  range  of  services  and  activi- 
ties to  assist  AFDC  recipients.  Program  components  may  include 
high  school  education,  remedial  education,  English  proficiency 
training,  job  skills  training,  job  readiness  activities,  on-the-job 
training,  work  experience,  and  post-secondary  education.  The 
department  is  also  federally  required  to  provide  child  care 
services  to  all  individuals  participating  in  the  program.  Other 
supportive  services  can  include  transportation,  liability 
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insurance,  auto  repairs,  medical  services,  counseling,  and  items 
necessary  to  search  for  employment. 

By  federal  regulation,  certain  mandatory  and  optional  compo- 
nents are  necessary  in  each  JOBS  program.   A  complete  program 
must  be  available  in  areas  in  which  75  percent  of  the  state's  adult 
AFDC  recipients  reside.  A  minimal  program  must  be  available 
where  an  additional  20  percent  reside.   A  minimal  JOBS  program 
must  offer  high  school  equivalency  education  and  at  least  one  of 
the  allowable  work  activities.   In  fiscal  year  1990-91  there  were 
9,900  AFDC  recipients  and  approximately  2,500  of  those  recip- 
ients were  enrolled  in  JOBS.   In  fiscal  year  1992-93,  the  depart- 
ment is  projecting  that  3,000  AFDC  recipients  will  be  served  by 
the  JOBS  program. 


County  Organization  The  department  has  implemented  complete  JOBS  programs  in  12 

counties  and  minimal  programs  in  17  counties.   Each  JOBS- 
designated  county  has  formed  a  local  task  force  which  is  respon- 
sible for  developing  a  county  plan  and  designating  a  lead  agency. 
The  county  plan  is  provided  to  the  department  for  evaluation 
and  for  funding  justification.  This  plan  outlines  the  type  of 
program  and  activities  that  will  be  provided  in  the  county  and 
identifies  the  roles  of  the  involved  agencies. 

A  lead  agency  in  each  county  is  responsible  for  coordinating  all 
employment  and  training  services  to  ensure  no  duplication 
between  programs  occurs.  This  agency  is  responsible  for  admin- 
istrative duties  at  the  county  level,  such  as  submitting  reporting 
forms  to  the  department  and  maintaining  participant  documenta- 
tion. The  actual  role  and  services  provided  by  the  lead  agency 
are  decided  by  the  task  force  and  outlined  in  the  county  plan. 
Lead  agencies  in  each  county  vary.  These  agencies  include  local 
Job  Service  offices.  Human  Resource  Development  Councils 
(HRDC),  community  colleges,  JTPA  operators,  and  YWCA 
organizations.  Typically,  the  lead  agency  provides  the  primary 
program  services  although  they  may  subcontract  various  services. 
Because  of  the  local  emphasis  of  JOBS,  program  organization  and 
activities  differ  extensively  between  counties. 
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Who  is  Served  by 
JOBS? 


There  are  three  groups  targeted  by  JOBS  regulations.  These 
include: 

1.  An  individual  who  is  receiving  AFDC  and  who  received  such 
aid  for  any  36  of  the  preceding  60  months. 

2.  A  custodial  parent  under  the  age  of  24  who  has  not  com- 
pleted high  school  or  is  not  enrolled  in  high  school  at  the 
time  of  AFDC  application. 

3.  A  member  of  a  family  in  which  the  youngest  child  is  16 
years  old. 

In  Montana,  these  target  groups  are  identified  by  a  self-evalua- 
tion form  completed  by  the  participant  as  part  of  the  enrollment 
process.  The  amount  of  matching  federal  funds  can  be  affected 
if  these  target  groups  are  not  served. 

There  are  two  other  groups  also  being  federally  targeted  in 
Montana,  Unemployed  Parents  and  Teen  Parents.  These  groups 
are  targeted  because  they  have  been  identified  as  "at  risk"  groups 
for  long-term  welfare  dependency.   Unemployed  parents  are 
those  participants  with  a  dependent  child  deprived  of  care  due  to 
the  unemployment  of  the  primary  wage  earner.   Unemployed 
Parent  program  activities  include  job  search,  work  experience, 
and  educational  activities.  The  Teen  Parent  Project  targets 
custodial  parents  aged  16  through  19  who  have  not  completed 
high  school  or  do  not  have  a  General  Education  Diploma  (GED) 
certificate.   Due  to  limited  funding,  this  project  is  currently 
funded  in  only  Flathead  County  and  Park  County. 


How  is  Program  Perfor- 
mance Measured? 


The  Montana  legislature  enacted  specific  statutory  performance 
standards  to  measure  performance  and  effectiveness  of  the  JOBS 
program  in  section  53-4-718,  MCA.  These  standards  which  are 
to  be  quantifiably  measured  include  the  following: 

1.    Placement  and  retention  of  participants  in  unsubsidized 
employment. 
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2.  Increased  earnings  of  participants  due  to  unsubsidized 
employment. 

3.  Reduction  in  the  number  of  individuals  and  families  receiv- 
ing AFDC  and  the  amount  of  AFDC  payments. 

The  department  is  statutorily  required  to  monitor  these  areas  to 
determine  the  level  of  program  performance,  administrative 
efficiency,  and  level  of  program  coordination.  SRS  is  required 
to  measure  the  extent  to  which  program  participation  increases 
the  employment  and  earnings  of  participants  and  decreases  their 
dependency  on  public  assistance. 

Although  specific  federal  performance  standards  have  not  been 
developed  for  JOBS,  SRS  has  established  some  program  guide- 
lines. These  guidelines  are  currently  used  by  SRS  staff  to 
measure  program  performance.  This  measurement  is  based  on 
calculating  different  types  of  participant  terminations  or  resolu- 
tions from  the  program.   Program  resolutions  are  defined  as 
termination  from  AFDC  for  any  reason  or  a  new  determination 
of  a  participant's  exempt  status.  Program  operators  are  required 
to  resolve  56  percent  of  the  JOBS  participants  served  during  the 
year.   Within  the  total  program  terminations,  75  percent  of  the 
participants  must  obtain  employment. 


Program  Funding  The  legislature  appropriated  $5,280,736  to  implement  the  JOBS 

program  statewide  in  the  1993  biennium.  General  Fund  expen- 
ditures are  projected  at  approximately  $890,000  per  fiscal  year. 
The  following  table  outlines  the  JOBS  funding  allocated  and 
average  AFDC  caseload  levels  of  designated  JOBS  counties  in 
fiscal  year  1992-93: 


Page  25 


Chapter  IV 
JOBS  Background 


Table 

4 

JOBS 

Fmd 

ng 

Levels  t   AFDC 

Caseloads 

bv  Couity 

Fiscal  Year  1992-93 

COUNTY 

Average 

« 

FUNDING  LEVEL 

Conclete  Programs 

AFDC  Cases 

Yellowstone 

799 

$542,170 

Hissoula 

6A3 

457,547 

Cascade 

617 

446,671 

Flathead 

394 

292,529 

Lewis  &  Clark 

329 

229,481 

Gallatin 

313 

118,380 

Si IverBow 

190 

285,448 

Ravalli 

HO 

124,187 

Lincoln 

134 

106,240 

Lake 

129 

94,915 

Hill/Liberty 

167 

109,400 

Minimal  Programs 

Beaverhead 

56 

23,516 

Blaine 

130 

44,750 

Carbon 

35 

15,265 

Custer 

86 

37,190 

Dawson 

47 

27,480 

Deer  Lodge/Powell 

111 

58,745 

Fergus 

34 

18,215 

Glacier 

71 

25,245 

Mineral 

24 

15,217 

Park 

78 

37,925 

Richland 

62 

24,942 

Rosebud 

39 

17,075 

Roosevelt 

79 

24,652 

Sanders 

43 

27,704 

Stillwater 

22 

14,345 

Valley 

64 

26,612 

Source:   C<«f) 

iled 

by 

the  Office  of 

the  Legis 

$3,245,846 

lative  Auditor  frca 

SRS 

records 

Program  Administration 


SRS  has  been  assigned  administrative  responsibilities  for  the 
JOBS  program.  The  department  has  assigned  approximately 
three  staff  to  monitor  program  activities,  develop  policies  and 
procedures,  and  establish  a  management  information  system. 
Local  administrative  duties  are  performed  by  program  operators 
and  county  welfare  offices  in  the  29  counties  which  offer  the 
program. 
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Introduction 


The  JOBS  program  was  created  to  provide  AFDC  recipients 
education,  training,  and  employment  that  will  help  avoid  long- 
term  welfare  dependency.  We  tested  several  operational  areas  to 
determine  statutory  compliance  and  program  effectiveness.   We 
concentrated  our  review  in  three  areas:   management  controls, 
management  information,  and  legislative  intent.   The  following 
sections  outline  the  results  of  our  program  review. 


Management  Controls 


The  basic  task  of  all  management  officials  is  to  design  and 
maintain  an  environment  where  staff  can  work  towards  meeting 
established  program  objectives.   We  identified  several  areas  that 
have  not  been  clearly  defined  or  established  for  JOBS  operations. 
Specific  controls  for  the  JOBS  program  had  not  been  established 
in  the  following  areas: 

1 .  Goals  and  objectives  were  not  measurable. 

2.  No  formal  policies  and  procedures  were  available. 

3.  Appraisals  of  staff  performance  were  not  completed. 

4.  Organizational  structure  had  complicated  program  opera- 
tions. 

The  goals  and  objectives  outlined  by  the  department  for  the 
program  appear  to  be  mission  statements  rather  than  measurable 
goals.  Current  goals  include  statements  on  improving  the  self- 
esteem  of  participants,  increasing  self-sufficiency  of  partici- 
pants, and  providing  adequate  supportive  services.  These  goals 
do  not  provide  specific  short  and  long  term  direction  for  staff  or 
provide  guidelines  for  measuring  program  achievements. 

After  two  years  of  operation,  JOBS  program  operators  have  not 
been  sent  formal  guidelines  or  operating  procedures.   As  a  result, 
one  operator  had  been  calculating  a  program  resolution  rate 
incorrectly  for  the  past  two  years.  This  has  resulted  in  misstated 
program  outcomes  for  that  operator. 


Page  27 


Chapter  V 
JOBS  Issues 


We  recognize  the  initial  emphasis  of  department  officials  has 
been  on  implementing  a  statewide  program.   Implementation  is 
now  complete.   We  believe  the  department  should  begin  focusing 
on  developing  management  controls  for  this  program.   Manage- 
ment controls  include  policies,  procedures,  and  established 
administrative  processes.  These  controls  provide  a  system  for 
measurement  of  program  activities  and  provide  managers  with 
useful  performance  information.   By  developing  goals  and 
objectives,  formalizing  a  policy  development  process,  and 
addressing  staffing  concerns,  program  administration  could  be 
more  effective.   Although  the  department  had  indicated  some 
controls  are  in  place,  we  believe  additional  steps  can  be  made. 
The  department  should  establish  a  formal  system  of  management 
controls. 


Recommendation  #2 

We  recommend  SRS  develop  management  controls  to  ensure 
more  effective  program  operation. 


JOBS  Management 
Information 


Available  JOBS  participant  and  program  information  is  compiled 
on  a  microcomputer  system  maintained  by  the  department.  To 
determine  the  accuracy  and  usefulness  of  data  maintained  on  this 
system,  we  reviewed  department  reports  and  conducted  staff 
interviews.   We  compared  program  information  to  statutorily 
mandated  performance  standards  and  data  obtained  from  other 
departments  and  program  operators. 


Department  Data  Does  Not 
Measure  Mandated  Perfor- 
mance Standards 


Due  to  the  department's  limited  JOBS  management  information, 
we  do  not  believe  its  efforts  specifically  measure  the  perfor- 
mance standards  outlined  in  statute.  The  management  informa- 
tion system  currently  used  is  not  designed  to  track  any  of  the 
prescribed  performance  standards.   For  example,  the  department 
has  no  method,  as  required  by  law,  to  track  the  dollar  savings  to 
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AFDC  as  a  direct  result  of  JOBS.   Program  operator  interviews 
and  file  reviews  also  indicated  participant  data  and  fiscal 
information  is  not  comprehensive  or  useful.   Program  operators 
noted  the  system  does  not  provide  a  comprehensive  list  of  clients 
they  should  serve  or  document  all  their  program  activities.   We 
found  there  were  1,053  resolutions  documented  by  JOBS  opera- 
tors but  less  than  400  (37  percent)  of  these  were  recorded  on  the 
JOBS  computer  system.   Lack  of  data  on  the  placement  and 
retention  of  participants  in  unsubsidized  employment  is  another 
example  of  noncompliance  with  statutory  performance  standards. 

Department  staff  have  indicated  there  are  several  reasons  for 
data  differences  including  changes  in  reporting  requirements  and 
technical  problems  with  the  interaction  between  the  JOBS  system 
and  the  AFDC  database.  As  a  result,  the  department  has  relied 
solely  on  program  operators  to  compile  the  program  statistics 
used  to  demonstrate  program  performance.  The  credibility  of 
the  program  is  in  doubt  due  to  the  lack  of  independent  depart- 
ment verification  of  program  performance.   Department  staff 
indicated  steps  have  been  taken  to  improve  the  accuracy  of 
system  data. 


Performance  Standards 
Where  Department  Efforts 
Could  Be  Strengthened 


The  department  should  improve  how  administrative  efficiencies 
are  measured  and  monitored.   During  on-site  monitoring  visits, 
department  staff  concentrate  on  program  operator  documenta- 
tion, not  on  local  programs'  results.  The  department's  methods 
for  monitoring  program  performance  could  be  improved  to 
provide  a  more  comprehensive  measure  of  performance  stan- 
dards and  to  fully  assess  administrative  efficiency. 


As  with  PWP,  we  found  limited  on-going  program  coordination 
efforts.   Active  coordination  with  other  job  training  programs, 
such  as  JTPA,  has  not  been  occurring.  Recent  steps  have  been 
taken  to  improve  program  coordination  via  the  formation  of 
several  multi-agency  work  groups.   Prior  to  these  efforts,  we 
were  unable  to  document  any  extensive  program  coordination  at 
the  state  level  either  internally  or  with  other  job  training 
programs.   Local  coordination  between  operators  is  required  by 
the  JOBS  county  plan. 
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Department  Procedures 
Could  Compensate  for 
Incomplete  Information 


We  found  data  from  other  departments  is  not  used  to  verify  and 
supplement  current  program  management  information.   We  used 
data  from  the  Department  of  Labor  and  Industry  to  indepen- 
dently evaluate  program  outcomes.   We  compared  the  662  place- 
ments recorded  on  the  JOBS  system  since  January  1990  to  the 
wage  and  employment  database  at  the  Department  of  Labor  and 
Industry.   We  found  there  were  510  claimed  placements  with 
wages  recorded  between  April  1991  and  June  1992.   Although  all 
claimed  placements  were  not  found,  the  Department  of  Labor 
and  Industry's  database  does  not  include  agricultural  or  self- 
employed  placements.  Overall,  the  wage  data  appears  to 
generally  support  program  operators'  claimed  employment  of 
JOBS  participants  and  provide  reasonable  verification  of  JOBS 
information.   Data  from  the  wage  database  should  be  used  by 
department  staff  to  monitor  program  outcomes. 


Based  on  our  audit  testing,  we  believe  the  department  should 
take  steps  to  improve  the  reliability  and  completeness  of  JOBS 
management  information. 


Recommendation  #3 

We  recommend  the  department: 

A.  Assess  the  validity  of  program  information  to  ensure 
program  requirements  are  accurately  measured. 

B.  Improve  methods  for  verifying  program  information 
and  outcomes. 


Is  the  JOBS  Program 
Meeting  Legislatiye 
Intent? 


Legislative  intent  in  the  JOBS  statutes  is  defined  as  providing 
recipients  of  AFDC  the  education,  training,  and  employment 
that  will  help  avoid  long-term  welfare  dependency.   We  com- 
pared available  program  information  to  the  performance  stan- 
dards outlined  in  Chapter  IV  (p.  24)  that  designate  areas  the 
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department  must  develop  and  monitor.   It  is  difficult  to  conclude 
on  whether  this  program  is  meeting  legislative  intent.   The 
department  has  not  been  measuring  the  designated  performance 
standards.  Therefore,  we  attempted  to  independently  document 
JOBS  program  outcomes  to  help  determine  program  success  rela- 
tive to  prescribed  legislative  intent. 

To  determine  how  successful  this  program  is  in  reducing  reliance 
on  public  assistance,  we  reviewed  the  AFDC  database  to  deter- 
mine if  those  participants  placed  into  employment  by  JOBS 
program  operators  were  no  longer  receiving  AFDC  benefits.   Of 
the  662  employments  claimed  since  January  1990,  we  found 
there  were  505  clients  (76  percent)  still  receiving  AFDC  benefits 
in  the  past  six  months. 

It  also  does  not  appear  program  participation  has  directly 
reduced  welfare  dependency  for  JOBS  placements.  We  also 
found  overall  AFDC  caseloads  have  not  significantly  decreased. 
The  following  figure  illustrates  the  overall  AFDC  caseloads  in 
the  past  ten  years. 
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Figure  5 
Montana  AFDC  Average  and  Projected  Caseloads 
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Source:  Cocnpiled  by  the  Office  of  the  Legislative  Auditor 
from  SRS  records 


A  Management  Plan 
Should  be  Developed 


JOBS  has  been  in  operation  for  three  years.  Department  officials 
and  program  operators  have  indicated  that  participants  served  by 
this  program  will  require  long-term  assistance  to  change  the 
cycle  of  welfare  dependency.   We  acknowledge  measuring  JOBS 
on  a  short-term  basis  may  not  account  for  or  consider  other 
long-term  benefits  of  this  program.  Outcomes  such  as  improved 
English  proficiency  or  attaining  a  high  school  diploma  cannot  be 
measured  through  the  current  statutory  performance  standards. 
To  prevent  long-term  reliance  on  welfare,  long-term  training 
and  supportive  services  may  be  required. 

The  department  has  indicated  the  JOBS  program  will  require  a 
long-term  commitment  to  program  recipients,  but  we  were  not 
able  to  document  any  definition  of  what  constitutes  a  "long- 
term"  commitment.  The  department  is  currently  not  measuring 
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Chapter  V 
JOBS  Issues 

short-term  or  long-term  program  performance.  We  believe  the 
department  should  consider  establishing  a  management  plan 
which  identifies  those  areas  which  could  be  measured  on  a  short- 
term  basis  in  addition  to  monitoring  the  long-term  outcomes 
specified  in  the  statutory  performance  standards. 


Recommendation  #4 

We  recommend  the  department  develop  a  management  plan 
for  the  JOBS  program  that  Includes: 

A.  Steps  needed  to  measure  statutory  performance  stan- 
dards. 

B.  Definitions  for  measurable  short-term  and  long-term 
program  outcomes. 
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DEPARTMENT  OF 
SOCIAL  AND  REHABILITATION  SERVICES 


MARC  RACICOT 
GOVERNOR 


PETER  S.  BLOUKE,  PhD 
DIRECTOR 


STATE  OF  MONTANA- 


PO    BOX  4210 

HELENA,  MONTANA  59604-4210 

(406)  444-5622 

FAX  (406)  444-1970 


March    15,    1993 

Angle  Grove 

Senior  Performance  Auditor 

Office  of  the  Legislative  Auditor 

State  Capitol 

Helena,  Montana  59620 

Dear  Angie: 

Enclosed  you  will  find  the  SRS  response  to  your  final  audit  report 
of  PWP  and  JOBS. 

Thank  you  for  the  work  you've  done  in  reviewing  PWP  and  JOBS. 
Please  contact  Marylis  Filipovich  if  you  have  any  questions  or  need 
further  information. 


Sincerely 


Roger  La  Voie 
Administrator 

JOBSPWP.mjf 
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"Working  Together  To  Empower  Montanans" 


SRS  RESPONSE 

PERFORMANCE  AUDIT  REPORT 

PROJECT  WORK  PROGRAM  AND  JOBS 

MARCH  12,  1993 

Project  Work  Program  (PWP) 

Auditor  Recommendation; 

We  recommend  that  the  legislature  re-define  program  intent  as  job 
search  or  discontinue  program. 

SRS  disagrees. 

Family  Assistance  Division  has  planned  steps  for  the  FY94  contract 
year  which  will  change  the  focus  of  PWP  by  providing  more  case 
management  for  the  client  while  demanding  more  job  development  and 
coordination  of  all  services  on  the  part  of  the  operators  and 
communities.  Performance  standards  have  been  developed.  One  of 
these  is  to  require  different  and  more  intensive  training  for 
clients  who  return  to  the  program  yearly.  Additionally,  the  use  of 
an  administrative  entity  or  the  addition  of  FAD  staff  in  employment 
and  training  programs  will  allow  PWP  staff  to  focus  on  program 
priorities.  We  see  the  future  of  PWP  as  a  more  developed 
employment  and  training  program  at  SRS  where  the  GRA  client  is 
known  and  the  agency  can  deal  with  myriad  of  problems  the  client 
possesses. 

Such  a  program  is  absolutely  necessary  if  General  Relief  Assistance 
is  a  required  benefit  program  in  this  state.  The  40  hour  a  week 
participation  requirement  and  the  20  days  of  participation  prior  to 
receipt  of  benefits  are  two  effective  methods  of  reducing  GRA 
caseload.  Redefinition  as  job  search  for  40  hours  a  week  would 
mean  a  less  effective  program  and  a  subsequent  increase  in  GRA 
caseload. 


Job  Opportunities  and  Basic  Skills  (JOBS) 

Auditor  Recommendation;    We  recommend  SRS  develop  management 
controls  to  ensure  more  effective  program  operation. 

SRS  concurs  with  this  recommendation. 

Corrective  Action  Plan: 

1.  Goals  and  objectives  must  be  measurable. 

The  department  will  have  measurable  goals  and  objectives  in 
place  by  SFY94. 

2.  No  formal  policies  and  procedures  were  available. 
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The  department  has  corrected  this  deficiency.  The  contractor 
operator  manual  was  issued  in  December,  1992.  The  automated 
system  procedure  manual  was  issued  during  Spring,  1992.  A 
major  update  was  issued  in  February,  1993. 

3.  Appraisals  of  staff  performance  were  not  completed. 

All  staff  performance  appraisals  will  be  completed  as  required 
by  the  department.  Pre-appraisals  will  be  in  place  by  the  end 
of  this  fiscal  year. 

4.  Organizational  structure  had  complicated  program  operations. 

Corrective  action  already  taken:  JOBS,  Food  Stamp  Job  Search, 
and  Project  Work  Program  are  now  administered  through  a  team 
approach.  The  SRS  Employment  and  Training  Team  includes  two 
county  directors,  two  employment  and  training  specialists,  a 
child  care  specialist,  and  team  leader.  Team  duties  include 
developing  goals  and  objectives  and  planning  for  future 
changes  for  the  program.  Goals,  objectives,  and  plans  are 
presented  to  the  division  management  team  for  final  approval. 
The  team  has  also  divided  functions  in  an  effort  to  distribute 
duties  in  an  effort  to  ensure  program  management  functions  can 
be  efficiently  accomplished.  For  example,  one  team  member 
handles  all  invoicing  for  JOBS,  FSJS,  and  PWP;  one  member 
handles  all  JOBS  system  and  reporting  duties;  written  JOBS 
policy  clarification  is  handled  by  one  team  member;  and 
contractor  monitoring  duties  are  clearly  divided  by  county. 

Corrective  action  plan: 

Fiscal  and  Reporting: 

a.  Federal  reports  are  completed  by  fiscal,  program 
staff  (using  JOBS  automated  system  data) ,  and  by 
Office  of  Management  and  Systems  (OMAS)  staff. 
Fiscal  and  program  staff  are  working  with  the 
federal  fiscal  representative  to  develop  a  plan  to 
correct  report  deficiencies  (FSA-331,  332,  and 
302)  . 

b.  OMAS  staff  will  continue  to  complete  the  FSA  3637. 
OMAS  staff  and  program  staff  met  in  December,  1992 
to  ensure  the  TEAMS  and  JOBS  system  information 
needed  for  the  report  could  be  obtained.  All 
needed  system  information  will  be  available  by 
SFY94. 

-    Tracking  federal  and  state  expenditures  on  an  ongoing 
basis 

a.  The  individual  contract  expenditure  spreadsheets 
(on  Lotus  123)  were  updated  as  of  February,  1993  to 
provide  an  accurate  running  account  of  expenditures 
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to  date. 

b.  OMAS  completed  an  analysis  of  state  and  federal 
spending  for  the  first  six  months  of  the  fiscal 
year  in  February,  1993. 

c.  Plan  for  improved  federal/state  expenditure 
tracking:  If  no  administrative  entity  is  chosen 
for  the  SRS  E&T  programs,  program  staff  will  work 
with  fiscal  and  system  staff  to  develop  an  accurate 
and  one-entry  fiscal  system  that  will  track  all 
federal  and  state  expenditures  and  easily  provide  a 
breakdown  of  expenditures.  System  difficulties  and 
inadequate  staffing  necessitate  a  target  date  of 
7/1/94  for  completion. 

If  an  administrative  entity  is  chosen  for  the  SRS 
E&T  programs,  a  system  to  track  federal/state 
expenditures  must  be  in  place  for  SFY94. 

Auditor  Recommendation:   We  recommend  the  department: 

A.  Assess  the  validity  of  program  information  to  ensure 
program  requirements  are  accurately  measured. 

B.  Improve  methods  for  verifying  program  information  and 
outcomes . 

SRS  concurs  with  this  recommendation. 

Corrective  Action  Plan: 

1.    Upgrade  of  JOBS  Automated  System  (JAS) 

a.    Current  system: 

System  fixes  were  made  in  October,  1992  to  ensure 
proper  referrals  of  eligible  AFDC  clients  are  made 
to  operators 

Further  system  fixes  are  scheduled  for  Spring,  1993 
to  correct  the  problem  of  participants  who  have 
been  served  and  are  not  recorded  on  the  system. 

Enhancements  to  the  system  will  be  completed  for 
the  SFY94  contract  year  to  ensure  we  are  collecting 
information  to  accurately  reflect  the  performance 
standards  required  of  contractors 

-  Documentation  of  placement,  retention,  and 
increased  earnings  of  participants  in  un-subsidized 
employment  will  be  done  quarterly  by  matching 
employment  placements  with  the  Dept.  of  Labor  and 
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Industry  ESD  report.   Quarterly  matches  will  start 
in  SFY94. 

-  AFDC  savings  will  be  calculated  by  matching  TEAMS 
data  with  JAS  employment  placement  data  starting  in 
SFY94.  Plan  includes  two  year  follow-up  for  each 
participant  placed  in  employment  through  JOBS. 

-  Technical  assistance:  The  federal  system 
representative  is  scheduled  to  work  with  program 
and  system  staff  in  May,  1993  to  assess  current 
system  and  provide  technical  assistance  to  improve 
system.  The  federal  technical  assistance 
contractor  will  work  with  Montana  staff  for  one 
week  during  SFY94.  We  have  requested  system 
development  assistance  as  a  part  of  the  training. 

2 .  Future  system  needs : 

More  efficient  use  of  automation  could  assist  SRS  in  meeting 
all  statutory  standards.  SRS  will  investigate  the  system 
options  during  SFY94. 

3.  Other  management  information  areas: 

a.  Monitoring  to  determine  the  level  of  program  performance 
and  identifying  administrative  inefficiencies 

-  increased  monitoring  of  all  program  operators  to  a 
minimum  of  twice  per  year  per  operator  commencing 
with  the  SFY94  contract  year.  This  is  contingent 
upon  securing  an  administrative  entity  or  3 
additional  FTEs. 

-  participant  interviews,  spot  checking  of  contractor 
reported  information  commencing  with  SFY94  contract 
year.  This  is  contingent  upon  securing  an 
administrative  entity  or  3  additional  FTEs. 

-  contractor  performance  compared  to  caseload  growth 
or  reduction  (done  through  analysis  of  data 
available  through  JAS  and  TEAMS) 

-  analysis  of  component  activity  compared  to 
participant  employment  placement  and  AFDC  cost  per 
case  reduction  and  AFDC  caseload  size  for  the  six 
largest  counties.  This  is  contingent  upon  securing 
an  administrative  entity  or  3  additional  FTEs. 

b.  Determining  the  level  of  program  coordination  taking 
place. 

-  Local  task  forces  required  to  consider  program 
coordination  in  choosing  a  contractor;  county  plan 
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requires  description  of  coordination. 

Enhancements  to  JAS  scheduled  for  SFY94  that  will 
track  referrals  and  placements  in  JTPA,  ABE,  Voc. 
Rehab. ,  etc. 

State  level  coordination  committee  in  place;  work 
groups  scheduled  to  complete  work  in  six  identified 
issue  areas  by  April,  1993.  Operator  training  to 
be  conducted  in  June  (JTPA  operators)  and 
combination  training  in  July. 

Auditor  recommendation;   We  recommend  the  department  develop  a 
management  plan  for  the  JOBS  program  that  includes: 

A.  Steps  needed  to  measure  statutory  performance  standards. 

B.  Definitions  for  measurable  short-term  and  long-term 
program  outcomes. 

SRS  concurs  with  this  recommendation. 

Corrective  Action  Plan: 

1.  Some  of  the  steps  needed  to  measure  statutory  performance 
standards  have  been  listed  in  answer  to  recommendation  #3 
above.  Further  steps  will  be  identified  in  conjunction  with 
defining  measurable  short  and  long  term  program  outcomes. 

2.  The  department  will  define  measurable  short-term  and  long-term 
program  outcomes  by  July  1,  1993. 

3.  The  department  will  design  evaluation  methods  for  each  of  the 
defined  short-term  and  long-term  program  outcomes  by  July  1, 
1993. 


Summary 

The  department  does  not  concur  with  the  recommendation  concerning 
the  PWP  program.  The  department  does  concur  with  all  JOBS 
recommendations  and  has  presented  a  corrective  action  plan. 
Meeting  all  corrective  action  goals  in  the  timeframes  specified  is 
contingent  upon  securing  an  administrative  entity  or  three 
additional  FTEs.  Timelines  must  be  adjusted  if  additional 
management  assistance  is  not  secured. 

\ssteam\legaud.rpl 
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